Universal channel coding for general output alphabet
نویسنده
چکیده
We propose a universal channel coding when each output distribution forms an exponential family even in a continuous output system. We propose two types of universal codes; One has the exponentially decreasing error with explicit a lower bound for the error exponent. The other attains the ǫ-capacity up to the second order. Our encoder is the same as the previous paper [CMP 289, 1087]. For our decoding process, we invent α-Rényi divergence version of Clarke and Barron’s formula for Bayesian average distribution, which are not required in the previous paper. Combing this formula and the information spectrum method, we propose our universal decoder. Our method enables us to treat a universal code of the continuous and discrete cases in a unified way with the second order coding rate as well as with the exponential decreasing rate. Index Terms Universal coding; information spectrum; Bayesian; type method
منابع مشابه
Upgraded Approximation of Non-Binary Alphabets for Polar Code Construction
An algorithm is presented for approximating a single-user channel with a prime input alphabet size. The result is an upgraded version of the channel with a reduced output alphabet size. It is shown that this algorithm can be used to reduce the output alphabet size to the input alphabet size in most cases.
متن کاملAn information-spectrum approach to joint source-channel coding
Given a general source V = fV gn=1 with countably in nite source alphabet and a general channel W = fW ng1 n=1 with arbitrary abstract channel input and output alphabets, we study the joint source-channel coding problem from the information-spectrum point of view. First, we generalize Feinstein's lemma (direct part) and Verd u-Han's lemma (converse part) so as to be applicable to the general jo...
متن کاملAnalogy and duality between random channel coding and lossy source coding
Here we write in a unified fashion (using “R(P,Q,D)” [1]) the random coding exponents in channel coding and lossy source coding. We derive their explicit forms and show, that, for a given random codebook distribution Q, the channel decoding error exponent can be viewed as an encoding success exponent in lossy source coding, and the channel correct-decoding exponent can be viewed as an encoding ...
متن کاملDistributed detection and coding in information networks
This thesis investigates the distributed information and detection of a binary source through a parallel system of relays. Each relay observes the source output through a noisy channel, and the channel outputs are independent conditional on the source input. The relays forward limited information through a noiseless link to the final destination which makes an optimal decision. The essence of t...
متن کاملIRWIN AND JOAN JACOBS CENTER FOR COMMUNICATION AND INFORMATION TECHNOLOGIES Reliability of Universal Decoding Based on Vector- Quantized Codewords
Motivated by applications of biometric identification and content identification systems, we consider the problem of random coding for channels, where each codeword undergoes lossy compression (vector quantization), and where the decoder bases its decision only on the compressed codewords and the channel output, which is in turn, the channel’s response to the transmission of an original codewor...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2015